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Quantization Design for Distributed Optimization 

Ye Pu, Melanie N. Zeilinger and Colin N. Jones 


Abstract 

We consider the problem of solving a distributed optimization problem using a distributed computing platform, where the 
communication in the network is limited: each node can only communicate with its neighbours and the channel has a limited 
data-rate. A common technique to address the latter limitation is to apply quantization to the exchanged information. We propose 
two distributed optimization algorithms with an iteratively refining quantization design based on the inexact proximal gradient 
method and its accelerated variant. We show that if the parameters of the quantizers, i.e. the number of bits and the initial 
quantization intervals, satisfy certain conditions, then the quantization error is bounded by a linearly decreasing function and the 
convergence of the distributed algorithms is guaranteed. Furthermore, we prove that after imposing the quantization scheme, the 
distributed algorithms still exhibit a linear convergence rate, and show complexity upper-bounds on the number of iterations to 
achieve a given accuracy. Finally, we demonstrate the performance of the proposed algorithms and the theoretical findings for 
solving a distributed optimal control problem. 


I. Introduction 

Distributed optimization methods for networked systems that have many coupled sub-systems and must act based on local 
information, are critical in many engineering problems, e.g. resource allocation, distributed estimation and distributed control 
problems. The algorithms are required to solve a global optimization problem in a distributed fashion subject to communication 
constraints. 

Inexact distributed optimization methods are attracting increasing attention, since these techniques have the potential to deal 
with errors, for instance caused by inexact solution of local problems as well as unreliable or limited communication, e.g., 
transmission failures and quantization errors. Previous work has aimed at addressing the questions of how such errors affect 
the algorithm and under what conditions the convergence of the distributed algorithms can be guaranteed. In Q, the authors 
propose an inexact decomposition algorithm for solving distributed optimization problems by employing smoothing techniques 
and an excessive gap condition. In our previous work ini, we have proposed an inexact splitting method, named the inexact 
fast alternating minimization algorithm, and applied it to distributed optimization problems, where local computation errors as 
well as errors resulting from limited communication are allowed, and convergence conditions on the errors are derived based 
on a complexity upper-bound. Some other related references for inexact optimization algorithms include ||6l, ifTOll and m. In 
na, an inexact proximal-gradient method, as well as its accelerated version, are introduced. The proximal gradient method, 
also known as the iterative shrinkage-thresholding algorithm (ISTA) [I], has two main steps: the first one is to compute the 
gradient of the smooth objective and the second one is to solve the proximal minimization. The conceptual idea of the inexact 
proximal-gradient method is to allow errors in these two steps, i.e. an error in the calculation of the gradient and an error 
in the proximal minimization. The results in iflTl show convergence properties of the inexact proximal-gradient method and 
provide conditions on the errors, under which convergence of the algorithm can be guaranteed. 

We consider a distributed optimization problem, where each sub-problem has a local cost function that involves both local and 
neighbouring variables, and local constraints on local variables. The problem is solved in a distributed manner with only local 
communication, i.e. between neighbouring sub-systems. In addition, the communication bandwidth between neighbouring sub¬ 
systems is limited. In order to meet the limited communication data-rate, the information exchanged between the neighbouring 
sub-systems needs to be quantized. The quantization process results in inexact iterations throughout the distributed optimization 
algorithm, which effects its convergence. Related work includes a, 11 , in and CD, which study the effects of quantization 
on the performance of averaging or distributed optimization algorithms. 

We propose two distributed optimization algorithms with progressive quantization design building on the work in lfT4l and 
ca. The main idea behind the proposed methods is to apply the inexact gradient method to the distributed optimization 
problem and to employ the error conditions, which guarantee convergence to the global optimum, to design a progressive 
quantizer. Motivated by the linear convergence upper-bound of the optimization algorithm, the range of the quantizer is set to 
reduce linearly at a rate smaller than one and larger than the rate of the algorithm, in order to refine the information exchanged 
in the network with each iteration and achieve overall converge to the global optimum. The proposed quantization method is 
computationally cheap and consistent throughout the iterations as every node implements the same quantization procedure. 

Y. Pu and C.N. Jones are with the Automatic Control Lab, Ecole Polytechnique Federale de Lausanne, EPFL-STI-IGM-LA Station 9 CH-1015 Lausanne, 
Switzerland, e-mail: {y . pu, colin.jones}@epfl. ch. 

M.N. Zeilinger is with the Empirical Inference Department, Max Planck Institute for Intelligent Systems, 72076 Tubingen, Germany, e-mail: 
melanie.zeilinger@tuebingen,mpg.de. 

This work has received funding from the European Research Council under the European Union’s Seventh Framework Programme (FP/2007-2013)/ ERC 
Grant Agreement n. 307608. The research of M. N. Zeilinger has received funding from the EU FP7 under grant agreement no. PIOF-GA-2011-301436- 
“COGENT”. 


2 


This work extends the initial ideas presented in ifTSlI for designing a quantization scheme for unconstrained distributed 
optimization. In particular, the paper makes the following main extensions and contributions; 

• Constrained optimization problems; We consider distributed optimization problems with convex local constraints. To 
handle the constraints, two projection steps are required. One is applied before the information exchange, and the other 
after. The reason to have a second projection is that after the information exchange, the quantized value received by 
each agent can be an infeasible solution subject to the local constraints. The second projection step therefore guarantees 
that at each iteration every agent has a feasible solution for the computation of the gradient. We present conditions on 
the number of bits and the initial quantization intervals, which guarantee convergence of the algorithms. We show that 
after imposing the quantization scheme including the two projections, the algorithms preserve the linear convergence rate, 
and furthermore derive complexity upper-bounds on the number of iterations to achieve a given accuracy. In addition, we 
provide a discussion about how the minimum number of bits and the corresponding minimum initial quantization intervals 
can be obtained. 

• Accelerated algorithm; We propose an accelerated variant of the distributed optimization algorithm with quantization 
refinement based on the inexact accelerated proximal-gradient method. With the acceleration step, the algorithm preserves 
the linear convergence rate, but the constant of the rate will be improved. 

• Distributed optimal control example; We demonstrate the performance of the proposed method and the theoretical results 
for solving an distributed optimal control example. 


II. Preliminaries 

A. Notation 

Let V G M"” be a vector. ||u|| and ||u||oo denote the I 2 and infinity norms of v, respectively. Note that Ikiloo < Iklb < 
yTijj||z;||oo- Let C be a subset of M"’'. The projection of any point v G M"” onto the set C is denoted by Proj{^(u) ;= 
argmin^g^. |j/i — u||. Let / ; 0 —>■ be a strongly convex function; a/ denotes the convexity modulus f(v) > + 

{df{^),v — /r) -f '^\\v — /i||^ for any v,fiG 0, where df{-) denotes the set of sub-gradients of the function / at a given 
point. L{f) denotes a Lipschitz constant of the function /, i.e. \\f{v) — /(/r)|| < L{f)\\v — ^||, Vu,p. G 0. The proximity 
operator is defined as 


/(^ 


1 , 


( 1 ) 


prox^(u) = argmin^ , ^ 

We refer to El and m for details on the definitions and properties above. The proximity operator with an extra subscript e, 
i.e. /r = proxj ^{v), means that a maximum computation error e is allowed in the proximal objective function; 


/(m) + 


< e-f min^, /(w)-f-llw-^ 


( 2 ) 


B. Inexact Proximal-Gradient Method 

In this section, we will introduce the inexact proximal-gradient method (inexact PGM) proposed in lfT4ll . Inexact PGM is 
presented in Algorithm [T] It addresses optimization problems of the form given in Problem |2.1| and requires Assumption |2.2| 
for convergence with a linear rate. 

Problem 2.1: 


min $(a:) = 4){x) i/’(a;) . 

Assumption 2.2: • (j) is a strongly convex function with a convexity modulus and Lipschitz continuous gradient with 

Lipschitz constant L(V(/)). 

• is a lower semi-continuous convex function, not necessarily smooth. 


Algorithm 1 Inexact Proximal-Gradient Method 

Require: Require G M""’ and r < 
for A: = 0,1, • • • do 

^k-hi ^ prox^^^gfc (x^ - T(Vt/)(x^) -h e^)) 

end for 


Inexact PGM in Algorithm allows two kinds of errors; {e^} represents the error in the gradient calculations of (f), and 
{e^ } represents the error in the computation of the proximal minimization in (|^ at every iteration k. The following proposition 
states the convergence property of inexact PGM. 
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Proposition 2.3 (Proposition 3 in HJID: Let {x^} be generated by inexact PGM defined in Algorithm[^ If Assumption 
holds, then for any fc > 0 we have: 


2.2 


r.k+1 


-a:*|| < (1-7) 


fc+i 


1 *° 


(3) 


where 7 = and and x* denote the initial sequence of Algorithm and the optimal solution of Problem 

respectively, and 


2.1 


p—0 


L(V<^)' 




As discussed in 03, the upper-bound in Proposition |2.3| allows one to derive sufficient conditions on the error sequences 
{e^} and {e^} for convergence of the algorithm to the optimal solution x*, where /r = 1 — 7: 

• If the series {||e*^|j} and {\/e*} decrease at a linear rate with the constant k < p., then \\x^ — x*|| converges at a linear 
rate with the constant p. 

• If the series {||e^|j} and {V^} decrease at a linear rate with the constant p < k < 1, then — a:*|| converges at the 
same rate with the constant k. 

• If the series {||e^||} and {Ve^} decrease at a linear rate with the constant k = p, then ||a;^ — a;*|j converges at a rate of 
0{k-p^). 

Remark 2.4: Compared to na, we modify the index of the sequence in Algorithmic from Xk to Xk+i and the corresponding 
index in Proposition |2.3| such that in Section |n^ the quantization errors have the same index as the quantized sequences. 


C. Inexact Accelerated Proximal-Gradient Method 

In this section, we introduce an accelerated variant of inexact PGM, named the inexact accelerated proximal-gradient method 
(inexact APGM) proposed in lfT4ll . Compared to inexact PGM, it addresses the same problem class in Problem [2. 1 1 and requires 


the same assumption in Assumption 2.2 for linear convergence, but involves one extra linear update in Algorithm 2, which 
improves the constant of the linear convergence rate from (1 — 7) to — yPy. 


Algorithm 2 Inexact Accelerated Proximal-Gradient Method 

Require: Initialize £ K"’"’ and r < 7 ;^^^ 

for A: = 0, 1, • • • do 


= prox^^ 

yk+i _ ^k+i _|_ 

end for 


i-vA 


- + eA 

_ 3 ,/c) 


Proposition 4 of lfT4ll presents a complexity upper-bound on the sequence — $(a:*)}, where the sequence is 

generated by inexact APGM. The following proposition extends this result and states a complexity uppe r-bou nd on 

Proposition 2.5: Let {x^} be generated by inexact APGM defined in Algorithmic If Assumption 2.2 holds, then for any 
fc > 0 we have: 


x^+^ - X* 


< a-AA 


Lti ( 2^/^xAA{x*) ^ 


\A> 


(4) 


where 7 = x^ and x* denote the initial sequence of Algorithm and the optimal solution of Problem 2.1 respectively. 


and 


0 '= = 




p=o ^ V / 


The proof of Proposition 2.5 will be given in the appendix in Section V-A The upper-bound in Proposition |2.5| provides 
similar sufficient conditions on the error sequences {e^} and {e^} for the convergence of Al gorithm [C which are obtained by 
replacing /r = 1 — 7 in the sufficient conditions for Algorithm in Section II-B with p = — Al- 


D. Uniform quantizer 

Let X be a real number. A uniform quantizer with a quantization step-size A and the mid-value x can be expressed as 


Q{x) = X + sgn(x — x) • A 


A 


1 

+ 2 


(5) 
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where sgn( ) is the sign function. The parameter A is equal to A = where I represents the size of the quantization interval 
and n is the number of bits sent by the quantizer. In this paper, we assume that n is a fixed number, which means that the 
quantization interval is set to be [a: — |,x + ^]. The quantization error is upper-bounded by 

||x- Q(x)|| < ^ = ■ (6) 

For the case that the input of the quantizer and the mid-value are not real numbers, but vectors with the same dimension Ux, 
the quantizer Q is composed of Ux independent scalar quantizers in Q with the same quantization interval I and corresponding 
mid-value. In this paper, we design a uniform quantizer denoted as Q^'( ) with changing quantization interval and mid-value 
at every iteration k of the optimization algorithm. 

III. Distributed optimization with limited communication 

In this section, we propose two distributed optimization algorithms with progressive quantization design based on the inexact 
PGM algorithm and its accelerated variant. The main challenge is that the communication in the distributed optimization 
algorithms is limited and the information exchanged in the network needs to be quantized. We propose a progressive quantizer 
with changing parameters, which satisfies the communication limitations, while ensuring that the errors induced by quantization 
satisfy the conditions for convergence. 


A. Distributed optimization problem 

In this paper, we consider a distributed optimization problem on a network of M sub-systems (nodes). The sub-systems 
communicate according to a fixed undirected graph G = (V, £). The vertex set V = {1, 2, • • • , M} represents the sub-systems 
and the edge set £ C V x V specifies pairs of sub-systems that can communicate. If {i,j) G S, we say that sub-systems i and j 
are neighbours, and we denote by Ni = {j\{i,j) ^ the set of the neighbours of sub-system i. Note that A/i includes i. We 
denote d as the degree of the graph G. The optimization variable of sub-system i and the global variable are denoted by Xi 
and X = [xf’, • • • , respectively. For each sub-system i, the local variable has a convex local constraint Xi G Ci C K"™;. 

The constraint on the global variable x is denoted by C = ni<i<M*^i' dimension of the local variable Xi is denoted by 
rrii and the maximum dimension of the local variables is denoted by m, i.e. fh := maxi<i<M rrii. The concatenation of the 
variable of sub-system i and the variables of its neighbours is denoted by xj^., and the corresponding constraint on xj^. is 
denoted by C_\f. = IljGAr With the selection matrices Ei and Fji, they can be represented as xj^. = E^x and Xj = FjiXj^-, 
j G Ni, which implies the relation between the local variable Xi and the global variable x, i.e. Xi = FjiEjX, j G N- Note 
that Ei and Fji are selection matrices, and therefore \\Ei\\ = \\Fji\\ = 1. We solve a distributed optimization problem of the 
formulation in Problem l3.ll 

Problem 3.1: 

M 

min /(x) = V/,{xa/-J 

X, Xj^. 

i—\ 

s.t. Xi GCi , Xi= FjiXM- , j gN , xaA, = EiX , i = 1, 2, • • • , M . 

Assumption 3.2: We assume that the global cost function /(•) is strongly convex with a convexity modulus cry and Lipschitz 
continuous gradient with Lipschitz constant L, i.e. ||V/(xi) — V/(x 2 )|| < L||xi — X 2 II for any xi and X 2 . 

Assumption 3.3: The local constraint Ci is a convex set, for i = 1, - ■ ■ , M. 

Assumption 3.4: We assume that every local cost function /;(•) has Lipschitz continuous gradient with Lipschitz constant 
Li, and denote Lmax as the maximum Lipschitz constant of the local functions, i.e. Lmax '■= maxi<i<M Li. 


B. Qualitative description of the algorithm 

In this section, we provide a qualitative description of the distributed optimization algorithm with quantization refinement 
to introd uce the main idea of the approach. We ap ply t he inexact PGM algorithm to the distributed optimization problem in 
Problem |3.l| where the two objectives in Problemare chosen as f and ip = Ni{xi), where /q 

denotes the indicator function on the set C^. The parameter 7 is equal to 



(7) 


The communication in the network is limited: each sub-system in the network can only communicate with its neighbours, 
and at each iteration, only a fixed number of bits can be transmitted. Only considering the first limitation, the distributed 
optimization algorithm resulting from applying the inexact PGM algorithm to Problem 3.1 is represented by the blue boxes in 
Fig. 0 At iteration k, sub-system i carries out four main steps: 


1. Send the local variable to its neighbours; 

2. Compute the local gradient; 
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Receive:- > Send: 


Figure 1: Distributed algorithm with quantization refinement for subsystem i at iteration k 


3. Send the local gradient to its neighbours; 

4. Update the local variable and compute the projection of the updated local variable on the local constraint. 

To handle the second limitation, we design two uniform quantizers (the salmon-pink boxes) for the two communication steps 
for each sub-system ^ and ^ using a varying quantization interval and mid-value to refine the exchanged information 
at each iteration. Motivated by the second suffic ient c ondition on the error sequences {e^} and {e^} for the convergence of 


the inexact PGM algorithm discussed in Section |II-B| (if the sequences {||e*^|j} and {v^} decrease at a linear rate with the 
constant (1 — 7) < k < 1 , then \\x^ — x*|j converges with the same rate), the quantization intervals are set to be a linearly 
decreasing function ^ = CatxJ^ and ^ = CpK^, with (1 — 7) < k < 1 and two constants Cq, and Cp as the initial intervals. 
We know that if for every fc, the values and V/i fall inside the quantization intervals, the quantization errors converge at 
the same linear rate with the constant k. In Section |III-C we will show that by properly choosing the number of bits n and 
the initial intervals Ca and Cp, it can be guaranteed that x’l and V/i fall inside the quantization intervals at every iteration 
and the quantization errors decrease linearly. 

We add an extra re-projection step (green box) into the algorithm, because the quantized value x^, can be an infeasible 
solution with respect to the constraints Ca/';. The re-projection step guarantees that at each iteration the gradient is computed 
based on a feasible solution. Using the convexity of the constraints, we can show that the error caused by the re-projected 
point = Projj;^ upper-bounded by the quantization error. To summarize, all the errors induced by the limited 

communication in the distributed algorithm are upper bounded by a linearly decreasing function with the constant k, which 
implies that the distributed algorithm with quantization converges to the global optimum and the linear convergence rate is 


preserved. These results will be shown in detail in Section III-C 


C. Distributed algorithm with quantization refinement 

In this section, we propose a distributed algorithm with a progressive quantization design in Al gorithm For every sub¬ 
system i, there are two uniform quantizers ^ and ^ using the formulation introduced in Section II-D with a fixed number 
of bits n, changing quantization intervals ^ and Ip ^ and changing mid-values x '^, and V/^ ^ for transmitting xf, and V/f 
at every iteration k. At iteration k, the quantization intervals are set to be ^ and 1^ ^ = CpK^, and the mid-values 

are set to be the previous quantized values x^ ^ = x^~^ and V/^ ^ The two parameters Ua = Z° ^ and Cp = ^ 

denote the initial quantization intervals. 

In this paper, " is used to denote a quantized value, e.g. x^ = i{x^) and ~ is used to denote a re-projected value, e.g. 

x^, = Projp^ The quantization errors are denoted by a\ = x'l — x’^ and Pf fi — V/f. 

Remark 3.5: We want to highlight Step 4 in Algorithm]^ because it is the key step that allows us to extend the algorithm 
in ns for solving an unconstrained distributed optimization problem to constrained problems. The re-projection step ensures 
that the point used to compute the gradient at each iteration is a feasible solution subject to the constraints Ca4 , which is a 
necessary condition for the convergence of the algorithm. 

In the following, we present four lemmas that link Algorithm to the inexact PGM and prove that Algorithm converges 
linearly to the global optimum despite the quantization errors. Lemma |3.6| states that due to the fact that the constraints are 
convex, the error between the re-projected point and the original point \\x^. — x^. || < \\x^. — x^. || is upper-bounded by the 
quantization error. Lemma [3^ shows that the inexactness resulting from quantization in Algorithm]^ can be considered as the 
error in the gradient calculation {e^} and the error in the computation of the proximal minimization {e^} in Algorithm 
Lemma 3.9 states that if at each iteration the values and V/f fall inside the quantization intervals, then the errors caused by 


quantization decrease linearly and the algorithm converges to the global optimum at the same rate. Lemma 3.13 gives conditions 


















































6 


Algorithm 3 Distributed algorithm with quantization rehnement 

Require: Initialize x~^ = a;° = 0, V/“^ = V/i(Proj|[;,^ (0)), (1 — 7) < k < 1 and t < 

for A: = 0,1,2, • • • do 

For sub-system i = 1, 2, • • • , M do in parallel; 

1: Update the parameters of quantizer i- i — and a;^ ^ 

2: Quantize the local variable: x^ = = x’^ + 

3: Send x^ to all the neighbours of sub-system i 
4: Compute the projection of x^.: = ProJc^v,. 

5: Compute V/f = 

6 : Update the parameters of quantizer i- Ip i ~ 

7; Quantize the gradient: V/f = Qp^iC^fi + 

8 ; Send V/f to all the neighbours of sub-system i 

9: Update the local variable: x^^ = Projci(^f ~ fj) 

end for 


on the number of bits and the initial quantization intervals, which guarantee that x^ and V/f fall inside the quantization intervals 


for each iteration. Once we prove the three lemmas, we are ready to present the main result in Theorem 3.14 
Lemma 3.6: Let C be a convex subset of 


and p, € C. For any point v € 

llAi-Projc(^^)ll < llAi-^'ll ■ 


", the following holds: 


( 8 ) 


Proof: Since p S C, we have Projj>(p) = p. Lemma 3.6 follows directly from Proposition 2.2.1 in ||2l- ■ 

Lemma 3.7: Algorithm is equivalent to applying the inexact proximal-gradient method in Algorithm to Problem 3.1 
with f = YkLi Mxm,), V' = Efci 


M 


and = ^\\x^ — x 


and 


k\\2 


. Furthermore, 


2=1 

\^k\\ 


M 

e’^ = J2 Ej V/. {xk )+Y.El Pi - E Ef V/. {xk) 

2=1 


M 


2=1 


and 


are upper-bounded by 


M 


M 

El 


/9 ^ 
i=l 


a. 


(9) 


( 10 ) 


The proof of Lemma [3^ will be provided in the appendix in Section V-B 

Remark 3.8: Lemma |3.7| shows that the errors ||e^|| and v/e^ are upper-bounded by functions of the quantization errors ||aj^|| 
and \\Pi\\. We want to emphasize that the quantization errors \\af\\ and \\l3f\\ are not necessarily bounded by a linear function 
with the rate k. They are bounded only if the values and V/i fall inside the quantization intervals that are decreasing at a 
linear rate. Otherwise, the quantiz ation errors |jaj^|| and ||/3f || can be arbitrarily large. 


From the discussion in Section 


y,k 


II-B 


we know that if ||e^|| and ve^ decrease linearly at a rate larger than (1 — 7 ), then 
converges linearly at the same rate as ||e^||. Lemma [ 3 ^ provides the hrst step towards achieving this goal. It shows 


that if the values of xf and V/f always fall inside the quantization interval, then the computational eiTor of the gradient 


and the computational error of the proximal operator ve^ as well as ||a;^ — a:*|| decrease linearly with the constant k. 

Lemma 3.9: For any parameter k, satisfying (1 — 7 ) < k < 1 and a fc > 0, if for all 0 < p < fc the values of x\ 
87 ff generated by Algorithm fall inside of the quantization intervals of ^ and j, i.e. 


\< - 


II V/f — V/^ Jloo < then the error sequences ||ef|j and \Qp satisfy 


|eP||<Ci«:f, V^<C2kP 


and 

and 

( 11 ) 


where Ci = 


and Co = ^ 


2^+1 


and 


\xP^^ — X* 


< K‘ 


P+1 


\X — X 


(Cl 


*11 satishes 

y/PXC2)K 


L(«:-f7-l)(l-7) 


( 12 ) 
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The proof of Lemma |3.9| will be provided in the appendix in Section |V-C| From Lemma |3.9| we know that the last missing 
piece is to show that the values and V/f fall inside the quantization interval at every iteration k. The following assumption 
presents conditions on the number of bits n and the initial quantization intervals Cq, and Cp, which guarantee that for each 
iteration x^ and in Algorithmfall inside the changing quantization intervals and the quantization errors decrease linearly 
with the constant k, which further implies that the Algorithm converges to the global optimum linearly with the same rate 


K. 


Assumption 3.10: Consider the quantizers ^ and j in Algorithm We assume that the parameters of the quantizers, 
i.e. the number of bits n and the initial quantization intervals Ca and Cp satisfy 


Oi + 02 


bi + 62 


2 "+i 


03 


< 


Ca 


2n+l 


2 "+i “ 2 
2^+1 - 2 


(13) 


(14) 


with 


Oi = 


(k + 1) 


02 = 


M\/rnK{K + l)(dLniax + sfL) + M\/mL{K + 7 — 1)(1 — 7) 


hi = 


h?, = 


imax(«: + l)||a;° - : 


hi = 


Lk{k + 7 — 1)(1 — 7) 
v/T C^i^dLmax A v/L) “t“ Ly; 


0-3 = 


Ms/dm{K + 1 ) 


L(«; + 7-1)(1-7) 

cd\fmL{K + 1 )(k + 7 — 1)(1 — 7) 


Lnis^xM s/ dmK{K + 1) + Ls/ dm{K + 7 — 1)(1 — 7) 
Lk{k + 7 — 1)(1 — 7) 


Lk{k + 7 — 1)(1 — 7) 


Remark 3.11: The parameters of the quantizers n, Ca and Cp are all positive constants. Assumption 3.10 can always be 
satisfied by increasing n, Ca and Cp. 


Remark 3.12: For a fixed n, inequalities (13i and (14i represent two polyhedral constraints on Ca and Cp. Therefore, the 
minimal Ca and Cp can be computed by solving a simple LP problem, i.e. minimizing Ca + Cp subject to Ca > 0, Cp > 0, 
and inequalities ( [T3] l and ( [l4| . Since the minimal n is actually the minimal one guaranteeing that the LP problem has a feasible 
solution, the minimal n can be found by testing feasibility of the LP problem. 

Lemma 3.13: If Assumption 3.10 is satisfied and (1 — 7) < k < 1, then for any k > 0 the values of x’l and Vff in 

Algorithm 3 fall inside of the quantization intervals of Qq i and Qn j, i.e. ||xf^ — x^ Jloo < and || V/f — V/§ 


I < 

loo — 2 


The proof of Lemma |3.13| will be provided in the appendix in Section |V-D| After showing Lemma |3.7[ Lemma |3.9| and 
Lemma |3.13| we are ready to pre sent the mai n theo rem. 

hold and (1 — 7) < k < 1 , then for A: > 0 the sequence {x^} generated 


Theorem 3.14: If Assumptions 


3.2 


3.4 


and 


3.10 


by Algorithm converges to the optimum linearly with the constant k and satisfies 

(Cl + V^C2)k 


llx'^+1 -X* 


< n 


fc +1 


||x°-x* 


L(k + 7-1)(1-7) 


(15) 


with Cl = 


M \/m{LjriaxdGa-\-y/dC ji 


2n + l 

Proof: Since Assumption 


and C 2 = ^ 


3.2 


3.4 


and 


3.10 


MvTrCo 

2 ’*+! ■ 

hold. Lemma 

k 

a,I 


3.13 


and Qp ^. 


states that for eac h ite ration the values x^ and V/* in 
Then from Lemma 


3.9 


we know that the error sequences 


< CiK^ and v/? < C 2 K^, and by Lemma 3.7 the sequence x* generated by Algorithmsatisfies 


Algorithm pi fall inside of the quantization intervals of Q] 

||e^|| and v e^ satisfy ^ ^ 

inequality •ED- 

Recalling the complexity bound in Proposition |2. 3 1 we know that for the case without errors the algorithm converges linearly 
with the constant 1 — 7. After imposing quantization on the algorithm, it still converges to the global optimum linearly but with 
a larger constant k > 1 — 7. We conclude that with the proposed quantization design, the linear convergence of the algorithm is 
preserved, but the constant of the convergence rate has to be enlarged in order to compensate for the deficiencies from limited 
communication. 


D. Accelerated distributed algorithm with quantization refinement 

In this section, we propose an accelerated variant of the distributed algorithm with quantization refinement in Algorithm 
based on the inexact accelerated proximal gradient method in Algorithm Compared to Algorithm Algorithm has an 
extra accelerating Step 5 y^. = x^_ + — x^^), and at each iteration the gradient V/f is computed based on y^,. 

The accelerating step improves the constant of the linear convergence rate of the algorithms from 1 — 7 to ,^1 — and 
changes the condition on the quantization parameter k to .^/l — yff < tc < 1 . 
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Algorithm 4 Accelerated distributed algorithm with quantization refinement 

Require: Initialize x~^ = x~^ = x° = 0, xj/_ = 0, V/~^ = ^/j(Projc^ (0)), ^1 — ^7 < k < 1 and t < ^. 

for A: = 0,1,2, • • • do 

For sub-system f, i = 1, 2, • • • , M do in parallel; 

1: Update the parameters of quantizer f and x’^ ^ = x^~^ 

2: Quantize the local variable: x^ = = x’^ + a'^ 

3: Send x^ to all the neighbours of sub-system i 
4: Compute the projection of x^,: x^. = Projc;v,. 

5: Accelerating update: y%-. = and yf = -b 

6 : Compute V/f = ^MykJ 

7: Update the parameters of quantizer f i = CpK^ and V/^ ^ ^ 

8 ; Quantize the gradient: V/f = Q^iC^fi) = '^fi+ Pi 

9: Send V/f to all the neighbours of sub-system i 

10: Update the local variable: x^~^^ = Proj^. FjiV f^) 

end for 


Lemm a 3.1 5: Algorithm is equivalent to applying the inexact accelerated proximal-gradient method in Algorithm to 


Problem 


3.1 


with (j) = Y,i=i 'll) = 'Zi=iiciki), 

M 


M 


M 


2=1 


2=1 


and = ^\\x^ — x 


and 


k\\2 


Ef Vfi (y^, )+J2eT Pi - E (yk ) 

2=1 

. Furthermore, ||e^|| and 

M 


are upper-bounded by 


<E^* - E( 


2=1 


11 


1 + v^ ^ 


M 


Eii/ 3 f 


2=1 


M 




(16) 


(17) 


i=l 


Proof: The proof follows the same flow of the proof of Lemma 3.7 The only difference is that at each iteration the 
gradient V/f is computed based on y^ , which is a linear combination of x^. and Hence, the upper-bound on the 


computational error of the gradient 


is a function of the linear combination of a 


k-l\ 


|af|] and ||/3f 


Lemma 3.16: For any parameter k satisfying ^ < /c < 1 and a A: > 0, if for all 0 < p < A: the values of x^ 


and V/f generated by Algorithm fall inside of the quantization intervals of ^ and Q‘ 
~ illoo < then the sequences ||ef|| and y/fp satisfy 

Ilex’ll < C'attt’ , . 

where Cg = , and \\xP+^ - a:*|| satisfies 


/3,i- 


i.e. \\x 7 - X' 




a,i||oo ^ 


< and 


^• 2 "+i 


— X* 


2"+i 


< K‘ 




2V$(xO) - ^(a:^) , (2C3 + 27^C4 + v^C4)ac ' 
yb> a,p{K - v^l - v^) • \/l - Vt 


(18) 


(19) 



Assumption 3.17: We assume that the number of bits n and the initial quantization intervals Ca and Cp satisfy 

Cg Cy ^ Cg 

’ 2 ^+t — 2 

Ca 


O 4 + Ug 
64 + 65 


2 ”+l 


U Cp <Cp 


( 20 ) 

( 21 ) 
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with 


04 = 


05 = 


06 = 


b4 = 


2 {k + l)y^$(a; 0 ) — $(a:*) 

K^/a^ 

6 M^/Wi{K + l)dLmax + My^K^K + 1){2'/L + y/o^) + a^My^{K — Y^l — ■ yjl — 


- VI - ^ 


2 M^/dm{K + 1 ) 


V - \/l “ v^) ■ V^ “ Vt' 

2-?^max(2At^ + 3 Av + 1) V$(x°) - <h(x*) 


^5 = 


K'^y/d^ 

LmaxV^{‘2‘K^ + 3k + 1 ) 


d + 


QMdLmax + Mk{2\/L + yo>) 


h = 


- \/l “ v^) ■ \l^- 'Jd 

2LmaxA^V^(2K^ + 3 k + 1) + O^\fdj^[K — \J^ — y^j) ' V^ ~ 


a^K{K - a/I - Vt) • \/l “ V7 

is satisfied and < k < 1, then for any k > 0 the values of xf and V/f in 

fall inside of the quantization intervals of Qq i and Q\ j, i.e. \\x^ — x^ Jloo < and || V/f — V/^ 


Lemma 3.18: If Assumption 
4 


3.17 


Algorithm 

The proof of Lemma 3.18 will be provi ded in th e appendix in Section [V^ 


Theorem 3.19: If Assumptions 


3.2 


3.4 


and 


3.17 


< Lll 
— 2 ■ 


hold and -^1 — .^7 < k < 1 , then for fc > 0 the sequence {x^} generated 
by Algorithm 1^ converges to the optimum linearly with the constant k and satisfies 




< k‘ 


k + 1 


2V^(xO)-$(a;V , ( 2 C 3 + 2v^C4 + V2^C4 )k 

Vd> cr^(K - VT^VTt) . ^1 - 


( 22 ) 


M-\/m{3LmaxdCa +K\/dC/3 


,.2n + l 


and C 4 = ^- 


with C 3 = 

Proof: The proof follows directly from the proof of Theorem |3.14| by replacing Lemma [3)7] Lemma [T9] and Lemma [3. 13 
by Lemma |3.15[ Lemma |3.16| and Lemma |3.18| ■ 


IV. Numerical Example 

This section illustrates the theoretical findings of the paper and demonstrates the performance of Algorithm]^ and Algorithm]^ 
for solving a distributed quadratic programming (QP) problem originating from the problem of regulating constrained distributed 
linear systems by model predictive control (MPC) in the form of Problem 4.1 For more information about distributed MPC, 
see e.g. 15], Hj and ifT^ . 

Problem 4.1: 

M N-1 M 

min EE 

s.t. z^{t + 1) = A^iZj{t) + ^ BijUjif) 

jeMi 

Ui{t) e Ui , 2:j(0) =Zi , i = 1, 2, • • • , M , 


M and N denote the number of subsystems and the horizon of the MPC problem, respectively. The state and input sequences 
along the horizon of subsystem i are denoted by Zi = [zf (0), V(1);' ’ ’ : V {^)Y = [^J (0))"“f (1); ’ ’ ’ {N— 1)]^. 

The discrete-time linear dynamics of subsystem i are given by Zi{t -f 1) = AnZj{t) + J2jej\f BijUj{t), where A^ and B^j 
are the dynamic matrices. The initial state is denoted by z^. The control inputs of subs ystem i are subject to local convex 
constraints Ui(t) G U^. kf, •) and if (•) are strictly convex cost functions. From Problem |4.l[ we can see that subsystem i is 
coupled with its neighbours in the linear dynamics. 

We randomly generate a distributed MPC problem in the form of Problem |4.1| We first randomly generate a connected 
network with M = 40 sub-systems. Each sub-system has 3 states and 2 inputs. The dynamical matrices An and Bij are 
randomly generated, i.e. generally dense, and the local systems are controllable and unstable. The input constraint Ui for 
sub-system i is set to Ui = {rti| — 0.4 • 1 < rti(f) < 0.3 • 1}, where 1 denotes the all-ones vector with the same dimension 
as Ui. The horizon of the MPC problem is set to N = 11. The local cost functions are chosen as quadratic functions 
li{zi{t),Ui{t)) = zf {f)QiZi{f) + uf {t)RiUi{t) and l{{zi{N)) = zf {N)PiZi{N), where Qi, Ri and Pi are identity matrices. 
The initial states Zi are chosen, such that more than 50% of the optimization variables are at the constraints at optimality. 
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Parameters 

Algorithm ^ 

Algorithm!^ 

Constant of rate 

1 - 7 = 0.8093 

- %/7 = 0.7505 

K 

0.9333 

0.7991 

r^min 

13 

19 


Table I; The parameters in 


Algorithm and Algorithm for solving Problem 


4.2 


Problem 4.2: 


M 


M 




min f{x) = ^ ^ xJf HiXMi + Kx^fi 

i=l i=l 

S.t. Xi G Ci 

By eliminating all state variables distributed MFC problems of this class can be reformulated as a distributed QP of the 


form in Problem 4.2 with the local variables Xi = Ui and the concatenations of the variables of subsystem i and its neighbours 
XTV'i- Matrix Hi is dense and positive definite, and vector hi is dense. The constraint Ci = is a polytopic set. 

Table shows the parameters chosen in Algorithm and Algorithm including the constants of the convergence rate of 
the algorithms, i.e. j = ^nd — yHj, the decrease rates of the quantization intervals k satisfying 1 — 7 < k < 1 for 
Algorithm 0 and < k < 1 for Algorithm and the minimum number of bits required for convergence Umin- 

Fig. 0s hows the relationship between the number of bits n and the minimum initial quantization intervals Ca and Cp, 
which satisfy Assumption 3.10 for Problem |4.2| We see that the minimum number of bits required for convergence is equal 
to rimin = 13, and as the number of bits n increases, the required minimum Ca and Cp decrease. 

Fig. 0 shows the performance of Algorithm 0 and Algorithm 0 for solving the distributed QP problem in Problem |4.2 
originating from the distributed MFC problem. For Algorithm 0 n is set to 13 and 15, respectively, and the initial quantization 
intervals Ca and Cp are set to corresponding minimum values satisfying Assumption 3.10 For Algorithm 0 n is set to 19 
and 23, and C„ and Cp to corresponding minimum values satisfying Assumption |3.17| In Fig. 0 we can observe that the 
proposed distributed algorithms with quantization converges to the global optimum linearly and the performance is improved 
when the number of bits n is increased. Due to the acceleration step. Algorithm 0 converges faster than Algorithm 0 However, 
Algorithm 0 requires a larger number of bits n to guarantee the convergence. 



Figure 2; Relationship between the number of bits n and the minimum initial quantization intervals Ca and Cp satisfying 
for Problem 


Assumption 3.10 


4.2 


originating from the distributed MPC problem. 


V. Appendix 


A. Proof of Proposition 2.5 


Proof: By the strong convexity of the function f, we know 
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Figure 3; Comparison of the performance of Algorithmand AlgorithrnH with different n and corresponding minimum Ca 
and Cp with the exact algorithms (no quantization errors) for Problem 


From Proposition 4 in m, it follows that 

rr j. I \/ rr^ • * 


(Jcj) 


p—0 


\ P -0 


By the fact < ^/v + y/Ji for any fi G M+, we simplify the inequality above as 

k 


y.k-\-l 


- < -(1 - V2($(a:0)-$(x*)) + W- + (^2L(V^ + J^WeP){l - 




^ 4> n 

^ p—0 


Taking the square-root of both sides of the inequality above, we get inequality 0- 


B. Proof of Lemma 3.7 


Proof: By the definition, the gradient computation error in Algorithm is equal to 

M M 

e^- = V/(i'=) - V/(a:'=) 

M MM 


2 = 1 


2 = 1 


2 = 1 


Then, 


M 


M 


\e'^\\<J2\\Ef\\-L,-\\S:’^^-x'^J\+J2\\E: 


'Til II ok 


Note that the matrix Ei is a selection matrix, then \\Ef\\ = 1. Since € Ca/". and x^, = Proj^^ ), Lemma 3.6 implies 
Pm - ^ Pm “ ^M.ll- Hence, we have 


M 


M 


M 


M 

< • Pm -^mJI +EP'II ^ E^* • E p'ii + EPf' 


2=1 


2=1 


2=1 j^j^i 


2=1 


By definition in 0 and the fact that G C and x^ — Proju-(x^), we know = ^\\x^ — x^|p. Lemma 3.6 again implies 
II— x^'ll < II x^^ x^‘||. Hence, we have 


P 2 , 


P 2 , 


M 




<^Ep'I' 
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C. Proof of Lemma \3.9\ 

Proof: From the property of the uniform quantizer, we know that if a;f and V/f fall inside of the quantization intervals 
of j and then the quantization errors and /3f are upper-bounded by 


\a^\\ < < Vm ■ 


^a, 

2 n+l 


2"+i 


ii/3fii < ■ wi^fWoo < 


ieM 




2^+1 ’ 


where m := maxi<i<M "m-i and d denotes the degree of the graph of the distributed optimization problem. From Lemma 3.7 
we have 


M 


2 = 1 


2 ”+i 


v /dm ■ , 

E 

i=l 


2 "+i 


and 




M r^ip 

''mP 


2 2"+i ■ 

i=l 

Since the quantization intervals are set to = CckP and ^ = CpK^, it implies that 

ML^axdV^ ■ CaKP M^/dM ■ Cprp 

lle^ll < — 

and 


2 "+i 


2 ”+i 


= CikP 


gfc < E . MVPiC^i^P ^ 

- 2 2 ’"+! 


with Cl = -^^v^Ct^'maxrfCQ-tvTlCg) (^2 = ^ • ^ where Lmax ■= maxi<i<M 7^^. Since (1 — 7 ) < At < 1, Lemma 


and Proposition 2.3 imply that for 0 < p < /c 

||a;P+i _ a;*|| < (1 - 7)P+i||x° - x*|| + 


3.7 


•E]At«(l-7)P+i-«-i 

9=0 


< kP+^ 


' 9=0 


-<? 


Since 0 < (1 — 7 ) < k < 1, by using the property of geometric series, we get that the expression above is equal to 


= nP+^ 

Ilx° X*ll 1 ('^l+'EiC' 2 ) 


< kP+1 

II 0 *11 1 iCi+V^C 2 )K 

L( 1 - 7 ) 

X _ 1~7 

K 

L{k +-f - 1){1 - j) 

Hence, inequality (12i is proven. 





D. Proof of Lemma 3.13 


Proof: We will prove Lemma 3.13 by induction. 


• Base case: When k = 0, since Ca and Cp are positive numbers and x, ^ and x^ are initialized to zero, it holds that 


xr - x“ 


= ||x° - X,- ^1 


= 0 < ^ and IIV/O - v/g 


= II V/f - V/r 


= l|V/.(i^J - 


V/.(Projc^^(0))||=0<%i = ^. 

Induction step: Let 
We will prove that 


Induction step: Let 5 > 0 be given and suppose that ||xf — xf, Jloo < ^ and ||V/f — V/5 Jloo < ^ for 0 < fc < p. 




73-1-1 

^OL,i 


(23) 


and 


iiv/r' 




g+t I 


< 



(24) 
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for i = 1, - ■ ■ , M. We first show (|2^. From Algorithm we know 




= -^fll 

< lla;S+i 


M 


r5 + l 




Viloo 


M 


< — X- 


\Y.ElF^,ai\ 


M 


< ||xS+i-a:*|U + l|a;®-a:* 




II ^2 IloO • 


2=1 


Since Ei and Fa are selection matrices, then \\Ei\\ = ||-Fm|| = 1. The term above is upper-bounded by 


M 


<\\x^+^-x^2 + \\x^-x^h + Y.\\an2 ■ 


q;,2Noo — 2 


By the assumption of the induction, we know \\x^ — x\ 
using Lemma 3.9 we obtain that the term above is upper-bounded by 


<kF and ||V/f - V/^ J|oo < E for 0 < fc < p. Then, 


II 0 *11 1 (Cl -f V^C'2 )k 

-1- K® 

IIt° 

*11 (Cl -f V‘2LC2)k 

L(K-f 7-l)(l-7)_ 

\\X 

^ " L(« + 7-1)(1-7)J 


+ 


My/mCaK^ 

2”+i 


By substituting Ci = ^'^(Lma^dCa+\FiCi3) and using the parameters defined in Assumption 


it follows that the expression above is equal to 


3.10 


= 


' C'a ^ Cp 

ai + 02 —h 03 ■ 


' 2^+1 


2ra+l 


By inequality (13i in Assumption 3.10 the term above is bounded by Thus, inequality (23 1 holds. In the 

following, we prove that inequality p4[) is true. 

Iiv/r'-v/|+i||oo = ||v/f+i-v/fiu 

= iiv/.(i^y)-v/,(i^j+/3fiioo 

< l|V/.(i^+')-V/,(i^J||oo + ||A®lloo 

< l|V/.(i^+')-V/.(i^J||2 + ||/3f||2 

< E^\\S:’P'E + Wl^iW 

< -^%-.\\ + Wf^^W 

Since x’p:\x%-^ G Cat,, = Projc^^(x^^) and = Proj^^^ Lemma |l6| implies - x^^^\\ < 

and \\x^, — x^_\\ < \\x^, — x^,\\. Hence, the term above is upper-bounded by 






< E dl^r^H + ll“fll) + 

jeJ^i 

< L,\\x^+^ -^o\\+L,Y^ (||af d| + ||afII) + ||/3f || 

l^.+i _ ^*11 +11^9 _ ^*11) + (||^.+i|| +1|„|||) +1|;3.|| . 


< L 


_ -^max V 


Again by the assumption of the induction, we know ||a;* — x^ Jloo < E fi ~ Jloo ^ for 0 < fc < p. 
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Then, Lemma |3.9| implies that the term above is upper-bounded by 


||a;° - a;*|| + 


(Cl + 


+ 


L{k + 7 — 1) j 

+^aj) , 


2 ”+i 


2 ”+i 


(Cl + V^C2)n 


<Ci„axK®+^ I ||x° - a:*|| + ' E ' ( I + CmaxK® | Ik'' - a::*|| + 


+ 


L(k + 7 - 1 ) j 

Lraax^ dfhCa{K^^^ + K®) y/dfhCpK^ 


(Cl + V^C2)k 

L{k + 7—1) 


(Cl + v^Ca)^ ' 

L{k + 7—1) 


2 "+i 


2 "+i 


By substituting Ci = (J^ = and using the parameters defined in Assumption 


it follows that the expression above is equal to 

— K-S+l 


3.10 


bi+b2- —XT + h ■ 


2 "+i 


2 "+i 


By inequality (14 1 in Assumption 


3.10 


c 

the term above is bounded by Thus, inequality (|24|l holds. 


We conclude that by the principle of induction, the values of and V//'' in Algorithm fall inside of the quantization 
intervals of ^ and i.e. ||xf - “ '^/+illoo k for all A: > 0. ■ 


E. Proof of Lemma 3.18 


Proof: The proof is similar to the proof of Lemma 3.13 The difference is that at each iteration the gradient V/f is 
computed based on , which is a linear combination of and We therefore only show a brief proof for the second 

step, i.e. the inequality IjV//'' — V/^ Jloo < ^ for any A; > 0 by induction. 

• Base case: When A: = 0, since Cp is positive a number, xf^. and x® are initialized to zero and V/“^ = V/kProjji^ (0)), 

it holds that llV/o - V/^o_J|oo = llV/o - V/-i||oo = l!V/.(y^.) - V/.(Projc^^ ( 0 ))|| = 0 < % = |^. 

• Induction step: Let p > 0 be given and suppose that ||x^ — x* Jloo < and ||V/f — V/|j||oo < for 0 < A: < p. 
We will prove 

llV/f+'-V/|+i|U<^ . (25) 

From the algorithm, we know 

iiv/r'-v/|+i|ioo = iiv/f+i-v/fiioo 

= l!v/4y^t')-W4y^.)+/3flloo 

< - ylf^W +C*||y^^ +Li\\ylf. - y^J| + ||/?f|| • 

By substituting = j^xlf. - vl/^ = and Lmax '■= maxi<i<M C*, and using the 

fact that YTT^ k 2 and k 1 , the expression above is upper-bounded by 

< W(2||x'^+1 - x*|| + 3||x« - x*|| + llx'^-i - x*||) + L^ax L (2|K'll + 3||af II + ||af ^H) + |kf || . 

]&Mi 

By the assumption of the induction and Lemma 3.16| we obtain that the above is upper-bounded by 

'2V$(xO)-$(x*) (2C3 + 2 v^C 4 + yJ^Ci)K 


<Ln,ax(2KS+i+3«:S + «:®-i) 




- \/i - a/t) • \/i - Vt 


Lmax’/wc?(2(®y + 3Z® ^ /) ^ 


2^+1 2^“^^ 

By substituting C 3 = ^'dflii 3 L,r^a:^dC^+K^/dCfi) (J 4 . = ^ ■ and using the parameters defined in Assump- 

3.17[ the expression becomes 


tion 


=«;S+^ 


04 + 05 ’ XTXT be 


2n+l 


2”+i 
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By inequality (21 1 in Assumption 

- I 1 

yJ9+1|I ^ LS. 


3.17 


the term above is bounded by 


= Thus, the inequality ||V/f''’^ — 


Ip i i|oo < 2 ^ holds. The proof of the induction step is complete. 

By the principle of induction, we conclude that the inequality||V/f — V/^ 


iiioo < holds for any fc > 0. 
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